View the Public Suffix List
The list is kept in source code control on Github. You can read more information on the format the list uses below. Please note that the list is encoded using UTF-8.
The copy on publicsuffix.org, linked below, is updated daily from Github. If you wish to make your app download an updated list periodically,
please use this URL and have your app download the list no more than once per day.
(The list usually changes a few times per week; more frequent downloading is pointless and
hammers our servers.)
To be kept informed of changes to the list, you can subscribe to an Atom change feed in your favourite feed reader.
A public suffix is a set of DNS names or wildcards concatenated with dots. It represents the part of a domain name which is not under the control of the individual registrant.
Specification
-
The list is a set of rules, with one rule per line.
-
Each line is only read up to the first whitespace; entire lines can also be commented using
//
.
-
Each line which is not entirely whitespace or begins with a comment contains a rule.
-
Each rule lists a public suffix, with the subdomain portions separated by dots (.) as usual. There is no leading dot.
-
The wildcard character * (asterisk) matches any valid sequence of characters in a hostname part. (Note: the list uses Unicode, not Punycode forms, and is encoded using UTF-8.) Wildcards
are not restricted to appear only in the leftmost position, but they must wildcard
an entire label. (I.e. *.*.foo is a valid rule: *bar.foo is not.)
-
Wildcards may only be used to wildcard an entire level. That is, they must be surrounded by dots (or implicit dots, at the beginning of a line).
-
If a hostname matches more than one rule in the file, the longest matching rule (the one with the most levels) will be used.
-
An exclamation mark (!) at the start of a rule marks an exception to a previous wildcard rule. An exception rule takes priority over any other matching rule.
Example
Here is an example (incomplete) list section. The rules are numbered, but the numbers would not appear in the real file:
1. com
2. *.jp
// Hosts in .hokkaido.jp can't set cookies below level 4...
3. *.hokkaido.jp
4. *.tokyo.jp
// ...except hosts in pref.hokkaido.jp, which can set cookies at level 3.
5. !pref.hokkaido.jp
6. !metro.tokyo.jp
The example above would be interpreted as follows, in the case of cookie-setting, and using "foo" and "bar" as generic hostnames:
-
Cookies may be set for foo.com.
-
Cookies may be set for foo.bar.jp.
Cookies may not be set for bar.jp.
-
Cookies may be set for foo.bar.hokkaido.jp.
Cookies may not be set for bar.hokkaido.jp.
-
Cookies may be set for foo.bar.tokyo.jp.
Cookies may not be set for bar.tokyo.jp.
-
Cookies may be set for pref.hokkaido.jp because the exception overrides the previous rule.
-
Cookies may be set for metro.tokyo.jp, because the exception overrides the previous rule.
Formal algorithm
Here is an algorithm for determining the Public Suffix of a domain. (Note: it may not be the most efficient algorithm.) The domain and all rules must be canonicalized in the normal way for hostnames - lower-case, Punycode (RFC 3492).
Definitions
-
The Public Suffix List consists of a series of lines, separated by
\n
.
-
Each line is only read up to the first whitespace; entire lines can also be commented using
//
.
-
Each line which is not entirely whitespace or begins with a comment contains a rule.
-
A rule may begin with a "!" (exclamation mark). If it does, it is labelled as a "exception rule" and then treated as if the exclamation mark is not present.
-
A domain or rule can be split into a list of labels using the separator "." (dot). The separator is not part of any of the labels. Empty labels are not permitted, meaning that leading and trailing dots are ignored.
-
A domain is said to match a rule if and only if all of the following conditions are met:
- When the domain and rule are split into corresponding labels, that the domain contains as many or more labels than the rule.
- Beginning with the right-most labels of both the domain and the rule, and continuing for all labels in the rule, one finds that for every pair, either they are identical, or that the label from the rule is "*".
Algorithm
-
Match domain against all rules and take note of the matching ones.
-
If no rules match, the prevailing rule is "*".
-
If more than one rule matches, the prevailing rule is the one which is an exception rule.
-
If there is no matching exception rule, the prevailing rule is the one with the most labels.
-
If the prevailing rule is a exception rule, modify it by removing the leftmost label.
-
The public suffix is the set of labels from the domain which match the labels of the prevailing rule, using the matching algorithm above.
-
The registered or registrable domain is the public suffix plus one additional label.
Divisions
The Public Suffix List is subdivided, using markers in the comments, into two sections, labelled as ICANN domains and PRIVATE domains.
ICANN domains are those delegated by ICANN or part of the IANA root zone database. The authorized registry may express further
policies on how they operate the TLD, such as subdivisions within it. Updates to this section can be submitted by anyone, but
if they are not an authorized representative of the registry then they will need to back up their claims of error with documentation
from the registry's website.
PRIVATE domains are amendments submitted by the domain holder, as an expression of how they operate their domain security policy.
Updates to this section are only accepted from authorized representatives of the domain registrant.
This is so we can be certain they know what they are getting into.
While some applications, such as browsers when considering cookie-setting, treat all entries the same, other applications may wish to
treat ICANN domains and PRIVATE domains differently. For example, Certification Authorities checking for
wildcard misissuance would not issue a "*.com" wildcard cert ("com" is in the ICANN domains list) but could legitimately issue a "*.appspot.com"
wildcard cert to the domain owner, in this case Google ("appspot.com" is in the PRIVATE domains list).
Test Data
There is a short set of test data available.
You will need to define a checkPublicSuffix() function which takes as
parameter a domain name and the registrable part of the domain, runs your implementation on the domain name and checks the result is the
registrable domain expected.
Thanks to Rob Stradling of Comodo for
providing this test data.